The role of the interaction matrix in mean-field spin glass models 
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Mean-field models of 2-spin Ising spin glasses with interaction matrices taken from ensembles 
which are invariant under O(N) transformations are studied. A general study shows that the 
nature of the spin glass transition can be deduced from the eigenvalue spectrum of the interaction 
matrix. A simple replica approach is derived to carry out the average over the O(N) disorder. The 
analytic results are confirmed by extensive Monte Carlo simulations for large system sizes and by 
exact enumeration for small system sizes. 



I. INTRODUCTION 



Mean-field models of spin glasses have been extensively studied over the last 30 years |1| . The first mean- field model 
to be studied thoroughly was the Sherrington-Kirkpatrick [pi model which exhibits a classical spin glass transition 
with a continuous transition in the Parisi overlap matrix Q a b at the transition temperature T c . The full solution 
to this problem requires continuous replica symmetry breaking pj , indicating an extensive number of pure states in 
the low temperature phase. Mean-field models with multi or p-spin, interactions exhibit discontinuous jumps in the 
+J , Parisi overlap matrix Q a t at the static transition temperature denoted by Tk for p > 2 However these systems 
exhibit a dynamical transition at a temperature Td > Tk indicating the onset of an extensive number of metastable 
states preceding the static transition. These models are of particular interest as the scenario of a dynamical transition 
followed by a static transition is observed in structural glasses || ||. For this reason the above type of behavior is 
often referred to as a structural glass transition. Potts type spin glasses can also exhibit first order phase transitions 
jij. In this paper we restrict ourselves to the study of spin glasses with 2-spin interactions and concentrate on the 
role of the interaction matrix in determining the nature of the phase transitions in the system. Mean-field spin glass 
type models appear in a wide range of contexts, they are of course the starting points for studying models of finite 
I ' dimensional spin glasses but also arise as models of neural networks, formulations of optimization problems and simple 
, models for protein folding. 

■ We shall analyze a class of mean field spin glass models with Hamiltonian 

on : i_ 

VO. H = --Y t JiiS i S i (1) 

£NJ ' where the Si are N Ising spins. The interaction matrix J is constructed via the following procedure 

J = O t AO (2) 

S where O is a random O(N) matrix chosen with the Haar measure. The matrix A is diagonal with elements inde- 
pendently chosen from a distribution p(X). The support of p(A) is taken to be finite and independent of N, this 
. ensures the existence of the thermodynamic limit. The interest of this kind of model is that one may average over 
the O(N) disorder O and then examine the nature of the spin glass phase as a function of the eigenvalue distribution 
p{\). In particular we shall show that the way in which p(A) vanishes at the maximal value of its support, A max , 
O ■ determines whether the glass transition is a classical spin glass transition or a structural glass transition. We show 
that a finite temperature classical spin glass transition occurs if the same model but with spherically constrained 
spins (such that Si € (— oo, oo) and Sf = N) exhibits a finite temperature phase transition. Where this is not the 
case we study the system using a one step replica symmetry breaking scheme to determine the dynamical transition 
temperature Td and the Kauzmann temperature Tk ■ Numerical simulations are carried out to confirm our analytical 
predictions on this class of models. We carry out both Monte Carlo simulations and exact enumeration calculations. 
The dynamical transition temperature Tp estimated from simulations agrees well with our analytic calculations. The 
exact enumeration carried out on small system sizes confirms the dynamical nature of the transition occurring at Td- 
Let us briefly recall some well studied models which fall into the class of spin glass models with interaction matrix 
given by the form of Eq. (||). The Sherrington-Kirkpatrick (2) (SK) model with J taken from the Gaussian ensemble 
Jij — Jji and Jij independent Gaussian random variables of zero mean and with J?- — 1/N can also can be written 
in the form of Eq. (^J) with the Wigner semi-circle law |7| density of eigenvalues given by 
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The Squared Interaction Matrix SK (SIMSK) model studied recently in || has interaction matrix J' — J T J, where 
the interaction matrix J is taken from the Gaussian ensemble described above. Here J' is also of the form given by 
Eq. (0). The density of eigenvalues here is given by 

,(A) = <^ (4) 

In fact the SIMSK model, at positive temperatures, is equivalent to the Hopfield model ]9| with TV patterns. This model 
was shown || to have different behavior at positive and negative temperatures. In the positive temperature Hopfield 
model ]l0| , the transition is a classical spinglass transition as in the SK model. However at negative temperature 
the model has a structural glass transition S. We also note that the minority game, which is an economics model, 
is closely related to the negative temperature or antifcrromagnetic Hopfield model and the same structural glass 
transition has been remarked ]ll] . In both the SK and SIMSK models one knows that the eigenvalues of J (the 
diagonal elements of A) are correlated 0, however we will see here that in the thermodynamic limit this correlation 
seems to be unimportant. One may also consider the more general Hopfield model with interaction matrix 

!>'>'; (5) 

where p = aN, for a of order 1, is the number of patterns. The case where x^ are Gaussian random variables of zero 
mean with correlation xf x" — fiy 8^" /N also falls into the class of models we are considering, as an arbitrary orthogonal 
transformation x M — > Ox' 1 gives an element in the same statistical ensemble. Here the density of eigenvalues of the 
matrix J is Jl2| 

p(X) = ( A + |~ Q ) ) + (1 — a)S(X) fora<l A = and A € [(1 — %/a) 2 , (1 + Va) 2 ] (6) 



2ttA 
(4A - (A + 1 



2vrA 



fora> 1 ;Ae [(V^-l) 2 ,(l + V^) 2 ] (7) 



Hence in the case a > 1 the density of eigenvalues is zero at the extremes of the support of p(X). In the case a < 1, 
the density of eigenvalues is non zero, and in fact diverges, at the lower band edge but stays zero at the upper band 
edge. We remark that the density of eigenvalues Eq. (]?]) when a = 1 is exactly the same density of eigenvalues as in 
the SIMSK model, as expected from our earlier discussion. 

Another example is the Random Orthogonal Model (ROM) studied by Marinari, Parisi and Ritort Jr|, where 

p(X) = aS{X - 1) + (1 - a)S(X + 1) (8) 

This model was extensively investigated in the case a — 1/2, and was shown to exhibit a structural glass transition. 
The case a = 1/2 is of particular interest because the high temperature series expansion in this case is equivalent to 
that of a frustrated mean-field model, the sine model, which has no quenched disorder. The ROM at a — 1/2 shows 
some rather interesting behavior, the static transition temperature Tr is extremely close to the temperature T4 where 
the annealed entropy vanishes. Below the static transition temperature the energy is almost constant or equivalently 
the specific heat is nearly zero. This implies that the ROM at a = 1/2 is almost a Random Energy Model (REM) 
at the static level. The simplest version of the REM JlJ] is given by considering a system with micro-states having 
independent energies. This situation arises by construction in the REM of Derrida where there are 2 N micro-states v 
of energies E v each chosen independently from a suitable distribution. The REM also arises when one considers the 
p — > 00 limit of p-spin interaction mean field spin glasses ]l4| , [l5| . Another example is the case of directed polymers on 
Cayley trees with random bond or site disorder |16| . Although in the directed polymer problem there are correlations 
between paths, these correlations are weak and the resulting thermodynamics is also REM-like. In this paper we will 
show that this REM like behavior is enhanced in the ROM model on increasing a above a = 1/2. 

At a more technical level, the problem of averaging over the O(N) disorder was solved by Marinari et al |l3| by 
transposing results of Itzykson and Zuber |ljj (based on generating function techniques), from random matrix theory. 
For completeness we also give a simple physical (though not rigorous) re-derivation of these averaging results. 
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II. AVERAGING OVER THE DISORDER 



We consider the partition function for a model with Gaussian spins with a random interaction matrix J with density 
of eigenvalues A denoted by p(X). The partition function at (3 = 1 is given by 



Z = J [] dSi exp I \ J2 JijSiSj - | £ Sf] 

i y ij i J 



(9) 



The partition function may be explicitly evaluated, as in the case of the p = 2 spherical spin glass model Eq), by 
passing to the basis of eigenvalues of the matrix J 



A \ A A / 



(10) 



The Gaussian integrals are easily performed yielding 



thus 

N 



ln(Z) = ^ln(2^)-iE ln ^- A ) (I 2 ) 



A 

Averaging over the disorder we obtain 



bx(Z) 1 
■ 9 = ^T " 



iln(27r)-iydAp(A)ln(/x-A) (13) 



We will now repeat the same calculation of g using the replica method. One replicates the system n times, where we 
shall consider the limit n — > 0: 



Z* = J J] dS? exp U E Ja E ^ ^ - f E ^) 

i, a \ ij a z,a / 



(14) 



where a = 1, • • • , n are replica indices. In a model where the interaction matrix is chosen to give an extensive free 
energy, we expect that 



exp U E Ja E s ? s ! = ex P (y TrG («) + n - e - 

\ ij a j 



(15) 



where Tr indicates the matricial trace over the Parisi order parameter matrix Q ab = SfSf, and the term n.c.t. 

denotes non extensive terms. The idea of the calculation that follows is to calculate g using the replica method and 
then extract G by comparing the result of this replica calculation with the result (|l3|). 
One has therefore for a generic G 



*~fll dS? exp fe&G(Q) - f E S f) 

i,a \ z,a / 



(16) 

• — 1 Z, I 

,a \ z,a / 

We impose the constraint NQ a b = SfS\ with a Fourier representation of the delta function to obtain 
~ J JT dk ab dQ ab \{ dS? exp j ^TrG(Q) + ^TrAQ - \ E Kb E Sf^ - | E S ? ) 

a,b i,n \ ab i i,a J 

]JdA ab dQ ab ex.p(NS*(Q,A)) (17) 



a , 6 
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where the action S*(Q, A) over the order parameters Q and A is given by 

S*(Q, A) = 1 [TrG(Q) + TrQA - Trlii (A + fil) + n\n(2n)} (18) 
The saddle point equations dS* /dA a i, — yield the relation Q = (A + /Ltl) -1 thus giving the result 

= i ln(27r) + i - ^extrg [^TrQ - TrG(Q) - Tr ln(Q)] (19) 

where extrQ indicates that the function in the square brackets is evaluated at an extremal or stationary point. For 
integer n this extremal value is of course the maximum, however in the limit n — > it is often the minimal value that 
should be taken. The nature of the stationary point chosen depends on the stability analysis of the Hessian matrix 
at that point. 

We now consider what form of ansatz one should make for Q in the variational problem contained in Eq. (|l9|). The 
physical nature of the problem makes it clear that the ansatz should be replica symmetric, the system minimizes its 
energy on condensing near the maximal eigenvalues of the matrix J and there is no frustration. We make the ansatz 
Q = qol + qU where U a b = 1 for all a, b. Making use of the fact that U 2 — nil, in the limit n->0we obtain 

g = lim 



o nN 

- + - ln(27r) - -extr qo , q [p(q + q) - G{q ) - qG'(q ) - ln(g ) - — 

ILL qg 



The stationarity condition with respect to q yields G'(qo) — p + i = which then gives 



.9=^+2 ln ( 2?r ) - 2 6Xtr9 ° [Wo ~ G(<Zo) ~ ln(<Zo)] (21) 



If one returns to expression for the action in Eq. (19), it is easy to understand the result in Eq. (pl|). The term in 
square brackets in Eq. (|l9|) clearly possesses an 0{n) invariance which is a consequence of the O(N) invariance of 
the original problem before the disorder average is carried out. The action ( p^ ) can therefore be written in terms of 
the eigenvalues of the matrix of Q a b, which by comparison with Eq. (pl|) must correspond to the possible values of 
go- We now equate the two different calculations for g, Eq. ( |l3| ) and Eq. (^l[) to obtain 

mm qo [nqo - G{q ) - \n(q )} = 1 + J d\p(X) ln( M - A) (22) 

The function 

/(/i) = l+ /dAp(A)ln(/x-A) (23) 



is clearly concave for fi > A max , where A max is the largest eigenvalue of the interaction matrix J. Hence the right 
hand side of Eq. (E2) has the form of a Legendre transform which can now be inverted to give the result 



G{z) = extr^z - / d\p(X) ln(/i - A)] - ln(z) - 1 (24) 

or explicitly 

G{z) = zp{z) - I dXp(X) ln(/i(z) - A) - ln(z) - 1 (25) 



(26) 



where fi(z) is given by the solution to 

p(X)dX 



p(z) — X 



The concavity of /(//) furthermore assures the uniqueness of fjt(z) and hence the annealed calculation (with n = 1 
replicas) is equivalent to the quenched calculation (with n = replicas). Hence the extremum taken in Eq. j24|), 
should be a minimum. Consequently we obtain the final result, 



G(z) = min^pz - / dXp(X) ln(^ - A)] - ln(z) - 1 (27) 
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This result can be shown to be identical to that used by Marinari et al |l3| who transposed the results of Itzykson and 
Zuber @ for integrals over unitary matrices to integrals over orthogonal matrices. We recall briefly the prescription 
of [jl3| in the form adapted to the definition of the Hamiltonian used here (there is a difference of definition by a factor 
of 2). In the method of G(z) is given by 

G(z)=J 1 ^ tZ ]- l) dt (28) 

where 



4>(z) = / dXp(X)- — (29) 

with j(z) given by the solution to the equation 

z = j(z) f dXp(X) 1 (30) 
J l-j(z)X 

Comparison of Eq. (j|^) with Eq. ( p6| ) shows that fi(z) = l/j(z). In addition one sees from Eqs. (§9) and ( |30| ) 

that ip(. z ) — z /j( z ) — zfi(z). When z <C 1 one has the solution p(z) w l/z, or j(z) « z from Eq. d26). In both 

prescriptions this yields (as it should), G(0) = 0. One also has that ip(0) = 1, thus differentiating Eq. ( |28| ) yields 

G'{z) = ix{z)-~ (31) 

which is the same equation as obtained on differentiating our result Eq. (p7|). The equivalence of the two averaging 
results is thus demonstrated. One of the advantages with the derivation of the averaging formula derived here is that 
it has a variational form. 

Here we shall give some specific examples of G(z) for some well known models and others we will study in this 
paper. 

• The Sherrington-Kirkpatrick model: The first example to consider is the Sherrington-Kirkpatrick model, 
for which the function G is known by simply averaging over the independent Gaussian elements of J: G(z) = 
z 2 /2. We shall show how to get this result from the formalism developed above. 

FromEq. @: 



1 f2 dX^ (32) 



2tt y_2 K z ) - ^ 
mO) - \jK z ) 



2 -A 



Solving this gives 



H(z)=z+- (33) 



z 



which gives G(z) = z 2 /2 by using Eq. (pH). 
• The Hopfield model: For all a Eq. ( p6| ) yields 

1 

The solution to this equation turns out to be surprisingly simple and is 



H-a + 1- ((/_t-a + l) 2 -4/i) 2 (34) 



a 1 

/*=-- + - (35) 

1 — z z 



Again integrating Eq.rt31|) gives 



G{z) = -aln(l - z) 



(36) 
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The ROM: In the ROM Eq. (p6|) reads 



1 -a 



Solving this yields 



fi 



/i - 1 /i + 1 



1 ± (1 + 4z(m + z)Y 
2~z 



(37) 



(38) 



where m = 2a — 1. The solution of \i should always be such that \i > X m ax hence we take the positive root in 
the above equation. The subsequent integration of Eq.(pl|) then gives 



G(z) 



1 r 
2 



(1 + Az{m + z)) 2 + to In {{I + 4z(to + z)) 2 + 2z + m 
In Ml + 4z(m + z)Y + 1 + 2mz) - mln(m + 1) - 1 - ln(2) 



(39) 



Setting to = yields the symmetric case a = 1/2 |^3| . For this special case, the partition function may be 
computed directly by using the O(N) invariance pj| |. 

• The semi-square law: The semi-square model is one with eigenvalues distributed uniformly between —1 and 
1 and hence p(X) — 1/2 for A e [—1,1]. In this case the Eq. (Eft) is 
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This leads to 



G{z) = In 



sinh(z) 



(40) 



(41) 



III. THE GENERAL CASE 



A. Representations of the Saddle Point Action 



We repeat the precedent calculation for an Ising spin Hamiltonian of form given in Eq. ([!]). Using the same 
technique as the previous section, after a little algebra, one finds 



In [Z r < 



ex.tr q^S**[Q, A] 



where 



S**[Q, A] = ^TrG(pQ) + ^TrQA + In 



Tr S ex P ( -\ ^2 KbS a S b 



(42) 



(43) 



this is the general form used in 13 . However, as the form of G is in general rather complicated, one may use the 
variational representation of Eq. (|27|) , introducing an additional order parameter matrix R to write 



In (Z n ) 



extT QjAtR S*[Q,A,R] 



(44) 



where 



8 11" 1 n 

S*[Q,A,R] = ^TrQR- -Tr / d\p(X)ln{R- A) - -Trln(/3Q) - - 



1. 



-TrQA + In 



T r Sa exp ( A ab S a S b 



(45) 
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The saddle point equation dS* /dQ = yields the relation A = Q 1 — f3R, this leads to 

In (ZP) 



N 



extrQ tR S[Q, R] 



where 



S[Q, R] = ~Tr j dXp(X) bx(R - A) - ^Trln(^Q) + In 
Z J z 



Tr Sa exp ( \ (PRab 



iab 



S a Sb 



(46) 



(47) 



The saddle point equations for this action yield 

Tr Sa S c S d exp ( 5 J]a,fc (fiRab - [Q\ab) S °.Sb 



led — 



and 



Tr Sa exp (i Y.a,b {PRab ~ [Q]ab) SaS t 



f3Q= / d\p(X)(R - X)- 1 



The problem may also be formulated purely in terms of the Parisi overlap matrix Q. In this version one has 

In C2~" 



N 



= extr Q S[Q] 



where 



S[Q] = ^TrG(PQ) - ^TrQG'(pQ) + In 



Tr Sa exp ^[G'(PQ)] ab S a S b 



(48) 



(49) 



(50) 



(51) 



Here we can show that if one uses the density of eigenvalues for the SK, SIMSK or Hopfield model in the above 
formula Eq. (^lj), the saddle point action for the corresponding model is reproduced. Any effects due to correlations 
between eigenvalues presumably only show up as finite size corrections. 



B. The Replica Symmetric and Annealed Cases 



We start by computing the annealed free energy which presumably is the correct free energy at sufficiently high 
temperatures. In the annealed case, that is n — 1, the free energy is given by: 



and the entropy: 



fann — ^ 2/3^^ 



ln(2) + iG(/3)-|G'09) 



(52) 



(53) 



In the replica symmetric (RS) ansatz Q a b = (1 — q)S a b + q, where 5 is the Kronecker symbol, and the action reads to 
order n: 



S[Q] = TlS RS [q] = l - [G(p(l-q))+PqG'(p(l-q))-p 2 q(l-q)G"(p(l-q))] 



(54) 



dz 



2tt 



e 2 In 



2 cosh 



(j3zy/qG»(j3(l - q) 



and the derivative of .Srs^] with respect to q is 

= £. [G » m _ q)) _ (3 qG '"((3(l q))} 



dz ^ 



/2tt 



: e " 2 tanh 2 



(pzy/qG»(J3{l - q) 



(55) 
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There are two replica symmetric saddle point equations 

G"G3(1 - g)) = /3gG"'(/3(l - g)) (56) 

and 

dz * 2 



q 



'2tt 



e-^r tanh 2 (/3zy/qG"{P(l - g)) (57) 



The first solution is unphysical |8j and thus q is given by Eq. (|57|). If we look for a second order phase transition, 
expanding near q — 0, we find that a continuous non-zero solution can appear at T c = 1//3 C where (3 C is determined 
by 

/3 2 C G"((3 C ) = 1 (58) 
This general equation was also derived in Jl3j . Now using Eq. ©, Eq. (||) becomes 

dX p(A) 2 = oo (59) 
G"c - A) 

and hence fi c — A max where A max is the largest eigenvalue of J. We thus find that T c is given by: 

¥ = I dX X^X ( 6 °) 

^ c J ^max ^ 

It is straightforward to see that the possibility of having a finite temperature phase transition in this Ising spin 
model depends on the existence of a finite temperature phase transition in the corresponding spherical model. In 
this case the critical temperature T c of the two transitions are the same. The Eq. ( |60| ) determining T c shows that if 
p(X)/(X max — A) is integrable over the support of p(X) then T c is finite, if it is not integrable then T c = 0. Hence if 
p(A) ~ (A max — A) 7 near X ma x then T c = for 7 < but a finite temperature second order phase transition is possible 
for 7 > 0. From Eq. ([59|) we also see that if 7 > 2 then the phase transition can be continuous but of higher than 
second order. 

The above results can be further verified in a more general than replica symmetric context by carrying out a Landau 
expansion. Writing Q a \, = 5 a b + w a b, the lowest order expansion around uj = of Eq.(pl]) is: 



S[Q] = -G{(3) + '-G"{(5) ((3 2 G"((3) - l) W + o(c 2 ) (61) 

The nature of the phase transition depends on the coefficient of Trw 2 in the expansion above. This coefficient only 
vanishes at /3 2 G"(/3) = 1, which agrees with the previous definition of T c . If T c 7^ 0, then a second order phase 
transition occurs at T c , and the subsequent replica symmetry breaking is determined by the terms of higher order in 
to in the expansion Eq. (|6l]). We note that the breaking of the 0(n) symmetry in replica space should favor replica 
symmetry breaking ||. 

In addition if we look at the TAP equations pp| in an external field, the linear expansion in the paramagnetic phase 
gives the following equations for the magnetizations m t : 



mi =j3hi+l3j2 Jijmj - (3G'((3) mi (62) 
Hence the staggered susceptibility in the direction of an eigenvalue A is 

XA = T^pxTWW) (63) 

' (64) 



H — A 



from Eq.(|3l|). Hence, the staggered susceptibility for the maximum eigenvalue A max diverges at the critical tempera- 
ture, as in the SK model 

We may now classify the phase transitions in the various models discussed here simply by examining the behavior 
of the density of eigenvalues p(X) at its upper band edge. 
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• SK model (Eq. (0)): 7=1/2- second order. 

• Hopfield (3 > (Eq. (|) and Eq. (0))): 7=1/2- second order 

• Hopfield (3 < 0, a > 1 (Eq. (0)): 7=1/2- second order. 

• Hopfield (3 < , a < 1 (Eq. (||)): delta function at A max - first order 

• SIMSK (Hopfield at a = 1) < (Eq. (§)): 7 = -1/2 - first order. 

• ROM (Eq. (||)): delta function at A max - first order. 

• Semi-square model: 7 = 0- first order. 



C. One Step Replica Symmetry Breaking 



In a variety of models such as the SK model, the Hopfield model, or the ROM, either the RS entropy or the annealed 
one is negative at low temperature. In this case, replica symmetry has to be broken. Indeed, the glass transition 
may be attributed to the existence of an extensive number of pure states. The complexity of these pure states can be 
computed within the following 1RSB ansatz || Q is a block diagonal matrix, where the blocks have size m x m 
and m < 1. Inside the blocks Q a b = (1 — q)S a b + q- Then the action reduces to: 



S[q, m] = ^—G((3(l - q j) + —G((3(l - q + qm)) - J (1 - q + mq) + - In ' " ' 



2m 2m 2 m VV-no v27r 

where: 



e -^cosh m (%/Az)^ (65) 



A = — (G'C3(1 - q + mq)) - G'((3(l - q))) (66) 
m 

Expanding S[q, m] around m = 1 gives: 

%, m] = -/?/„„„ + (m - l)V(g) + ((1 - m) 2 ) (67) 

The extremum of the effective potential V(q) at q = contributes to the paramagnetic value —[3f an m whereas a local 
minimum at non zero q corresponds to the entropy of pure states. The potential is easily computed: 



V (q) = dS[<lM 



dm 



(68) 



= -\{G{P{l-q))-G{(3)+ (3qG\f3)) + ^-^-\-e-^ f -J= cosh(%/Az) lncosh(%/Az) (69) 

2 2 7-oo v27r 



where: 



X = f3(G'(P)-G'(P(l-q))) (70) 

This is exactly the expression for the annealed complexity of the solutions of the TAP equations found in pfJ] . 

The dynamical transition occurs when the number of pure states becomes extensive. The dynamical transition 
temperature Tjj and the dynamical overlap qo are determined from the equations: V"{c[d) = V(Qd) = (qD 7^ 0). 
The static transition occurs when the number of pure states is no longer extensive, so the static transition temperature 
Tk and the static overlap qs are determined from the equations: V(qs) — V'(qs) = (qs ^ 0). 

The first derivative of the potential is: 

V'( q ) = ^-G"(P(l-q))( q -T( q )) (71) 



where 



T(q)=e~^ I -^Le"^tanh 2 (VAz)cosh(\/Az) (72) 
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FIG. 1: Various temperatures arising in the Random Orthogonal Model as a function of a. 



and the second derivative is: 



V"(q) = yG"(/3(l - q)) (1 - Y'{q)) - ^G"'(/3(l - q)) (q T(q)) (73) 



After some algebra, one finds for q* such that V'(q*) = 0: 



b 2 f > r°° d7 



The paramagnetic solution g = is always a stationary point of V(q) and the second derivative of V is: 

V"'(0)-^G"(/3)(l-/3 2 G"(/3)) (75) 

Again, this quantity may have several possible behaviors, depending on f3 c 

• (i) [3 C — oo. One sees from Eq.(p6|) that for all temperatures f3 2 G"(f3) < 1, and then V"(0) > 0. Hence either 
the only local minimum of the effective potential is at q = 0, or there is another solution appearing at Td > 
where the system undergoes a dynamical transition, with a non zero dynamical overlap q^. 



• (ii) j3 c = l/T c < oo. From Eq. (3 2 G"{(3) < 1 if (3 < (3 C and /3 2 G"(/3) > 1 if (3 > /3 C . Here, the stationary 

point q = becomes unstable at T — T c so there is no dynamical transition below T c (one can not exclude a 
dynamical transition at Td ^ 0, but as expected T c < Td). We remark from Eq. (^) that if G' is convex, then 
there is no discontinuous dynamical transition and the system undergoes a classical spin glass transition at T c . 

This 1RSB calculation can be done for the Random Orthogonal Model, where a discontinuous dynamical transition 
is expected. The dynamical and static temperatures To and Tk arising in the Random Orthogonal Model as a 
function of a are shown in Fig. ([l]). Also shown is the temperature Ta at which the annealed entropy disappears. It 
was noted by Marinari et al that for the ROM at a = 1/2 Ta is very close to Tk- Indeed we see that for all a > 1/2 
this is the case. This means that the statics of these models for a > 1/2 is very close to that of the Random Energy 
Model (REM). This analogy is further supported by the values of q in the one step solution which are already very 
close to 1 at Tk- 
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semi-square 


ROM a = 0.6 


ROM a = 0.8 


N = 30 


N = 200 


N = 30 


N = 200 


N = 30 


TV = 200 


number of samples 


40 


40 


40 


40 


40 


40 


number of runs 


200 


20 


200 


20 


200 


20 


cooling rate (MCS) 


5 x 10 5 


5 x 10 5 


10 6 


10 6 


2 x 10 6 


2 x 10 6 



TABLE I: Parameters used in the different Monte Carlo simulations. 



IV. NUMERICAL SIMULATIONS 

In this section we describe the numerical simulations carried out to test our theoretical results. We shall concentrate 
on the case of the Random Orthogonal Model at different values of a and the semi-square model, which are systems 
exhibiting the structural glass transition. 

The numerical generation of the interaction matrices Jy is carried out as follows. We take a random orthonormal 
basis of x( fe ) 1 < k < N of R N and construct Jy via 

J^EW^f (76) 

k 

where, in the case of a continuous density of eigenvalues p(X) each A& is drawn independently from the distribution with 
probability density p(X). In the case of the ROM, in order to reduce sample to sample fluctuations, aN eigenvalues 
+1 and N(l — a) eigenvalues —1 are randomly assigned to each eigenvector. As mentioned above, this has the form of 
a Hopfield model M but where the patterns are strictly orthogonal, and not simply statistically orthogonal, and 
where each pattern x( fe ) is weighted by Afe. The construction of a statistically 0(N) invariant basis x( fe ) is carried out 
by choosing for the x^ fe ' the (normalized) eigenvectors of the statistically O(N) invariant symmetric Gaussian matrix 
K with Kij = (Jij/yN, each being Gaussian of mean and variance 1. 

We have carried out two types of numerical simulations. Monte Carlo simulations on systems of size N = 200 
were performed, in order to validate the high temperature predictions of the theory. Below the dynamical transition 
temperature Tn it is impracticable to equilibrate the system for these large system sizes, however one may estimate 
the value of Tp by examining at which temperature the measured results differ from the annealed calculation. The 
results of our calculations are compatible with these estimations. In each of the Figs. is shown the dynamically 

measured energy per spin for a system of size 200. The corresponding cooling rate, number of samples and number 
of runs are shown table The equilibration time constituted 90 percent of the time spent at each temperature 
and the measurements were made during the last 10 percent. Also shown on Figs. is the calculated value of 

To (vertical dotted line) and the value of Tk (vertical dashed line). We see that for the system sizes studied here, 
the departure from the annealed energy and the onset of the characteristic, almost fiat energy plateau, is in good 
agreement with the calculated value of To . 

For system sizes of N = 30 spins, the energy can be calculated by exact enumeration over all the micro-states. The 
results for the energy can be compared with those of dynamical simulations and the theoretical predictions. For the 
dynamical simulations on systems of size N — 30 the cooling rate, the number of samples and the number of runs 
are also indicated in table (|l|). The exact enumeration averages where taken over at least 20 samples. Also shown in 
Figs. (§-|)-§) are the results of these simulations. We see that the results of the exact enumeration, even for the small 
system sizes used here, are in excellent agreement with the theoretical predictions. For the system with a = 0.6 (Fig. 

) we see that the plateau in the static energy is compatible with the calculated value of Tjc but the Monte Carlo 
simulation with N = 30 is clearly out of equilibrium at temperatures below Tjj. In Fig. (||) for a = 0.8 the theoretical 
prediction is that Tk <C Tb- We see that the exact enumeration result is in perfect agreement with the annealed 
energy down to energies around Tk (shown enlarged in the figure inset). The Monte Carlo results for systems of size 
N = 30 are however still clearly out of equilibrium. In Fig. (Q) are shown the results for the semi square model. 
We see that the dynamic and Kauzmann temperatures are very close, however here the results of the Monte Carlo 
simulations and exact enumeration for the systems of size N = 30 are much closer, the dynamically measured energies 
are however still slightly lower that the static ones measured by exact enumeration. 

V. CONCLUSIONS 

In this paper we have examined the statics of a class of fully connected generalized random orthogonal models. 
We have shown how the average over the O(N) disorder can be carried out using a simple replica method recovering 
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FIG. 2: Energies per spin for the ROM with a = 0.6 : Monte Carlo simulations for systems of size N = 200 (squares) and 
N = 30 (circles), exact enumeration for N — 30 (long dashed line), annealed (solid line). Also shown are the calculated values 
of Td (vertical dotted line) and Tk (vertical dashed line). 




FIG. 3: Energies per spin for the ROM with a = 0.8 : Monte Carlo simulations for systems of size N = 200 (squares) and 
N = 30 (circles), exact enumeration for N = 30 (long dashed line), annealed (solid line). Also shown are the calculated values 
of Td (vertical dotted line) and Tk (vertical dashed line). In the inset is shown the low energy behavior of the annealed energy 
and the energy calculated by exact enumeration. 



the results of random matrix theory. This method has the useful property of giving a variational form for the result. 
Depending on the behavior of the density of eigenvalues at the band edges, we have seen that one either obtains a 
classical spin glass transition or a structural glass transition. Our results suggest that in the thermodynamic limit 
only the density of eigenvalues is important for the statics of these models. This classification should be useful in a 
wide range of models. It was noted that the ROM with a bimodal distribution of eigenvalues behaves like a random 
energy model for large values of a, in agreement with previous studies where it was shown already to have very close 
to REM-like behavior at a = 1/2. 

We have carried out numerical simulations on the generalized form of the original ROM model which support our 
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FIG. 4: Energies per spin for the semi-square model : Monte Carlo simulations for systems size N = 200 (squares) and N = 30 
(circles), exact enumeration for N = 30 (long dashed line), annealed (solid line). Also shown are the calculated values of Tr> 
(vertical dotted line) and Tk (vertical dashed line). 



analytical calculations. Simulating small system sizes via Monte Carlo dynamics and by exact enumeration confirms 
the dynamical nature of the transition occurring at Try. Further questions arising form this study will be interesting to 
address. One can look at the number of metastable states in such systems to better understand the geometric reasons 
leading to the glassy behavior . Also the fact that even small system sizes stay out of equilibrium on numerically 
accessible time scales and the fact that they can be studied by exact enumeration means that one may study finite 
size effects and hence activated processes on the dynamical transition as proposed in p3[ . The formulation of the 
saddle point action in Eq. (47) also allows one to study the decomposition of the Parisi overlap matrix Q on the 
basis of eigenvectors of the problem, this may give a more geometric picture of the nature of the glassy phase of these 
models. 
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